Papers by Alison R Yan
GovScape: A Public Multimodal Search System for 70 Million Pages of Government PDFs (2026.acl-demo)
Copied to clipboard
Ying-Hsiang Huang, Claire Gong, Shreya Shaji, Alison R Yan, Leslie Harka, Albert Du, Anjali Shubha Gopal, Samuel J Klein, Shannon Zejiang Shen, Mark E. Phillips, Trevor Owens, Kyle Deeds, Benjamin Charles Germain Lee
| Challenge: | Efforts over the past three decades have produced web archives containing billions of webpage snapshots and petabytes of data. |
| Approach: | They propose a public search system that supports multimodal searches across 10,015,993 federal government PDFs from the 2020 End of Term crawl. |
| Outcome: | The proposed system supports multimodal searches across 10,015,993 federal government PDFs from the 2020 End of Term crawl (70,958,487 total PDF pages) significant compute cost for GovScape’s pre-processing pipeline for 10 million PDFs was approximately 1,500, equivalent to 47,000 PDF pages per dollar spent on compute. |